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Constraint propagation algorithms form an important part of most of the constraint programming 
systems. We provide here a simple, yet very general framework that allows us to explain several 
constraint propagation algorithms in a systematic way. In this framework we proceed in two steps. 
First, we introduce a generic iteration algorithm on partial orderings and prove its correctness 
in an abstract setting. Then we instantiate this algorithm with specific partial orderings and 
functions to obtain specific constraint propagation algorithms. 

In particular, using the notions commutativity and semi-commutativity, we show that the AC-3, 
PC-2, DAC and DPC algorithms for achieving (directional) arc consistency and (directional) path 
consistency are instances of a single generic algorithm. The work reported here extends and 
simplifies that of Apt [1999a] . 
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1.1.2 [Algorithms]: Analysis of algorithms; 1.2.2 [Automatic Programming]: Program syn- 
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1. INTRODUCTION 
1.1 Motivation 

A constraint satisfaction problem, in short CSP, is a finite collection of relations 
(constraints), each on some variables. A solution to a CSP is an assignment of 
values to all variables that satisfies all constraints. Constraint programming in 
a nutshell consists of generating and solving CSP's means of general or domain 
specific methods. 

This approach to programming became very popular in the eighties and led 
to a creation of several new programming languages and systems. Some of the 
more known examples include a constraint logic programming system ECL l PS e 
(see Aggoun et al. [1995]), a multi-paradigm programming language Oz (see, e.g., 
Smolka [1995]), and the ILOG Solver that is the core C++ library of the ILOG 
Optimization Suite (see ILOG [1998]). 

One of the most important general purpose techniques developed in this area 
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is constraint propagation that aims at reducing the search space of the consid- 
ered CSP while maintaining equivalence. It is a very widely used concept. For 
instance on Google, http://www.google.com/ on December 6th, 2000 the query 
"constraint propagation" yielded 26800 hits. For comparison, the query "NP com- 
pleteness" yielded 21000 hits. In addition, in the literature several other names have 
been used for the constraint propagation algorithms: consistency, local consistency, 
consistency enforcing, Waltz, filtering or narrowing algorithms. 

The constraint propagation algorithms usually aim at reaching some form of "lo- 
cal consistency" , a notion that in a loose sense approximates the notion of "global 
consistency" . Over the last twenty few years many useful notions of local con- 
sistency were identified and for each of them one or more constraint propagation 
algorithms were proposed. 

Many of these algorithms were built into the existing constraint programming 
systems, including the above three ones. These algorithms can be triggered cither 
automatically, for example each time a new constraint is generated (added to the 
"constraint store"), or by means of specific instructions available to the user. 

In Apt [1999a] we introduced a simple framework that allowed us to explain 
many of these algorithms in a uniform way. In this framework the notion of chaotic 
iterations, so fair iterations of functions, on Cartesian products of specific partial 
orderings played a crucial role. We stated there that "the attempts of finding general 
principles behind the constraint propagation algorithms repeatedly reoccur in the 
literature on constraint satisfaction problems spanning the last twenty years" and 
devoted three pages to survey this work. Two references that are perhaps closest 
to our work are Benhamou [1996] and Telerman and Ushakov [1996]. 

These developments led to an identification of a number of mathematical proper- 
ties that are of relevance for the considered functions, namely monotonicity, infla- 
tionarity and idempotence (see, e.g., Saraswat, Rinard and Panangaden [1991] and 
Benhamou and Older [1997]). Functions that satisfy these properties are called clo- 
sures (see Gierz ct al. [1980]). Here we show that also the notions of commutativity 
and so-called semi-commutativity are important. 

As in Apt [1999a], to explain the constraint propagation algorithms, we proceed 
here in two steps. First, we introduce a generic iteration algorithm that aims to 
compute the least common fixpoint of a set of functions on a partial ordering and 
prove its correctness in an abstract setting. Then we instantiate this algorithm with 
specific partial orderings and functions. The partial orderings will be related to the 
considered variable domains and the assumed constraints, while the functions will 
be the ones that characterize considered notions of local consistency in terms of 
fixpoints. 

This presentation allows us to clarify which properties of the considered func- 
tions are responsible for specific properties of the corresponding algorithms. The 
resulting analysis is simpler than that of Apt [1999a] because we concentrate here 
on constraint propagation algorithms that always terminate. This allows us to 
dispense with the notion of fairness. Moreover, we prove here stronger results by 
taking into account the commutativity and semi-commutativity information. 
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Fig. 1. A crossword grid 
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Fig. 2. A solution to the crossword puzzle 



1.2 Example 

To illustrate the problems here studied consider the following puzzle from Mack- 
worth [1992]. Take the crossword grid of Figure 1 and suppose that we are to fill it 
with the words from the following list: 

—HOSES, LASER, SAILS, SHEET, STEER, 
—HEEL, HIKE, KEEL, KNOT, LINE, 
—AFT, ALE, EEL, LEE, TIE. 

This problem has a unique solution depicted in Figure 2. 

This puzzle can be solved by systematically considering each crossing and elim- 
inating the words that cannot be used. Consider for example the crossing of the 
positions 2 and 4, in short (2,4). Neither word HOSES nor LASER can be used in 
position 2 because no four letter word (for position 4) exists with S as the second 
letter. Similarly, by considering the crossing (2,8) we deduce that none of the words 
LASER, SHEET and STEER can be used in position 2. 

The question now is what "systematically" means. For example, after considering 
the crossings (2,4) and (2,8) should we reconsider the crossing (2,4)? Our approach 
clarifies that the answer is "No" because the corresponding functions /2,4 and /2,8 
that remove impossible words, here for position 2 on account of the crossings (2,4) 
and (2,8), commute. In contrast, the functions /2,4 and do not commute, so 
after considering the crossing (4,5) the crossing (2,4) needs to be reconsidered. 
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In Section 6 we formulate this puzzle as a CSP and discuss more precisely the 
problem of scheduling of the involved functions and the role commutativity plays 
here. 

1.3 Plan of the Paper 

This article is organized as follows. First, in Section 2, drawing on the approach 
of Monfroy and Rcty [1999], we introduce a generic iteration algorithm, with the 
difference that the partial ordering is not further analyzed. Next, in Section 3, we 
refine it for the case when the partial ordering is a Cartesian product of component 
partial orderings and in Section 4 explain how the introduced notions should be 
related to the constraint satisfaction problems. These last two sections essentially 
follow Apt [1999a], but because we started here with the generic iteration algorithms 
on arbitrary partial orderings we built now a framework in which we can also discuss 
the role of commutativity. 

In the next four sections we instantiate the algorithm of Section 2 or some of its 
refinements to obtain specific constraint propagation algorithms. In particular, in 
Section 5 we derive algorithms for arc consistency and hyper-arc consistency. These 
algorithms can be improved by taking into account information on commutativity. 
This is done in Section 6 and yields the well-known AC-3 algorithm. Next, in 
Section 7 we derive an algorithm for path consistency and in Section 8 we improve 
it, again by using information on commutativity. This yields the PC-2 algorithm. 

In Section 9 we clarify under what assumptions the generic algorithm of Section 2 
can be simplified to a simple for loop statement. Then we instantiate this simplified 
algorithm to derive in Section 10 the DAC algorithm for directional arc consistency 
and in Section 11 the DPC algorithm for directional path consistency. Finally, in 
Section 12 we draw conclusions and discuss recent and possible future work. 

We deal here only with the classic algorithms that establish (directional) arc 
consistency and (directional) path consistency and that are more than twenty, re- 
spectively ten, years old. However, several more "modern" constraint propagation 
algorithms can also be explained in this framework. In particular, in Apt [1999a, 
page 203] we derived from a generic algorithm a simple algorithm that achieves the 
notion of relational consistency of Dechter and van Beek [1997]. In turn, by mim- 
icking the development of Sections 10 and 11, we can use the framework of Section 
9 to derive the adaptive consistency algorithm of Dechter and Pearl [1988]. Now, 
Dechter [1999] showed that the latter algorithm can be formulated in a very general 
framework of bucket elimination that in turn can be used to explain such well- 
known algorithms as directional resolution, Fourier-Motzkin elimination, Gaussian 
elimination, and also various algorithms that deal with belief networks. 

2. GENERIC ITERATION ALGORITHMS 

Our presentation is completely general. Consequently, we delay the discussion of 
constraint satisfaction problems till Section 4. In what follows we shall rely on the 
following concepts. 

Definition 2.1. Consider a partial ordering (D, C ) with the least element _L 
and a finite set of functions F := {/i, . . ., fk} on D. 
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— By an iteration of F we mean an infinite sequence of values do , d\ , ■ ■ ■ defined 
inductively by 

d := _L, 

where each ij is an element of [l..k]. 

— We say that an increasing sequence do Q d\ C d 2 ■ ■ . of elements from D even- 
tually stabilizes at d if for some j > we have di = d for i > j. □ 

In what follows we shall consider iterations of functions that satisfy some specific 
properties. 

Definition 2.2. Consider a partial ordering (D, C ) and a function / on D. 
— / is called inflationary if x C f(x) for all x. 

— / is called monotonic if x C y implies f(x) C f{y) for all x, y. □ 

The following simple observation clarifies the role of monotonicity. The subse- 
quent result will clarify the role of inflationarity. 

Lemma 2.3 (Stabilization). Consider a partial ordering (D, C ) with the least 
element _L and a finite set of monotonic functions F on D. 

Suppose that an iteration of F eventually stabilizes at a common fixpoint d of the 
functions from F. Then d is the least common fixed point of the functions from F. 

Proof. Consider a common fixpoint e of the functions from F. We prove that 
dCe. Let do, d\, . . . be the iteration in question. For some j > we have di = d 
for i > j. 

It suffices to prove by induction on i that d, C e. The claim obviously holds for 
i = since do = _L. Suppose it holds for some i > 0. We have di + i = fj(di) for 
some j £ [l..fc]. 

By the monotonicity of fj and the induction hypothesis we get fj(di) C fj(e), 
so d i+ i C e since e is a fixpoint of fj. □ 

We fix now a partial ordering (D, C ) with the least clement _L and a finite set 
of functions F on D. We are interested in computing the least common fixpoint of 
the functions from F. To this end we study the following algorithm inspired by a 
similar, though more complex, algorithm of Monfroy and Rety [1999] defined on a 
Cartesian product of component partial orderings. 

Generic Iteration Algorithm (GI) 

d := -L; 
G:=F; 

while G ± do 

choose g £ G; 

G:=G-{g}; 

G := G U update(G, g, d); 

d := g(d) 

od 
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where for all G, g, d the set of functions update{G, g, d) from F is such that 

A. {/ g F- G | f(d) = d A f(g(d)) + g(d)} C update (G,g,d), 

B. g(d) = d implies that update{G, g, d) = 0, 

C. g(g(d)) ^ g(d) implies that g G update(G 1 g, d). 

The above conditions on update(G, g, d) look somewhat artificial and unneces- 
sarily complex. In fact, an obviously simpler alternative exists according to which 
we just postulate that {/ G F — G | f(g(d)) ^ g(d)} C update(G , g , d) , i.e., that we 
add to G at least all functions from F — G for which the "new value", g(d), is not 
a fixpoint. 

The problem is that for each choice of the update function we wish to avoid the 
computationally expensive task of computing the values of f(d) and f(g(d)) for the 
functions / in F — G. Now, when we specialize the above algorithm to the case of a 
Cartesian product of the partial orderings we shall be able to avoid this computation 
of the values of f(d) and f(g(d)) by just analyzing for which components d and 
g(d) differ. This specialization cannot be derived by adopting the above simpler 
choice of the update function. 

Intuitively, assumption A states that update(G , g , d) at least contains all the 
functions from F — G for which the "old value" , d, is a fixpoint but the "new 
value", g(d), is not. So at each loop iteration such functions are added to the set 
G. In turn, assumption B states that no functions are added to G in case the value 
of d did not change. Note that even though after the assignment G := G — {g} we 
have g G F - G, still g G {/ G F - G \ f(d) = d A f(g(d)) ^ g(d)} does not hold 
since we cannot have both g(d) = d and g(g(d)) ^ g{d). So assumption A docs 
not provide any information when g is to be added back to G. This information is 
provided in assumption C. 

On the whole, the idea is to keep in G at least all functions / for which the 
current value of d is not a fixpoint. 

An obvious example of an update function that satisfies assumptions A, B and 
C is 

update(G,g,d) := {/ g F - G | /(d) = d A f(g(d)) ? g(d)} U C(g), 

where 

c (g) = {9} if g(.9( d )) ^ g( d ) and otherwise C(g) = 0. 

However, again, this choice of the update function is computationally expensive 
because for each function / in F — G we would have to compute the values f(g(d)) 
and f{d). 

We now prove correctness of this algorithm in the following sense. 
Theorem 2.4 (GI). 

(i) Every terminating execution of the GI algorithm computes in d a common fix- 
point of the functions from F. 

(ii) Suppose that all functions in F are monotonic. Then every terminating ex- 
ecution of the GI algorithm computes in d the least common fixpoint of the 
functions from F. 
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(Hi) Suppose that all functions in F are inflationary and that (D, C ) is finite. 
Then every execution of the GI algorithm terminates. 

Proof. 

(i) Consider the predicate I denned by: 

I:=VfeF-G /(d) = d. 

Note that I is established by the assignment G := F. Moreover, it is easy to 
check that by virtue of assumptions A, B and C / is preserved by each while 
loop iteration. Thus / is an invariant of the while loop of the algorithm. (In fact, 
assumptions A, B and C are so chosen that / becomes an invariant.) Hence upon 
its termination 

(G = 0) A J 

holds, that is 

V/ G F /(d) = d. 

(ii) This is a direct consequence of (i) and the Stabilization Lemma 2.3. 

(Hi) Consider the lexicographic ordering of the strict partial orderings (D, □) and 
(TV, < ) , defined on the elements of D x Af by 

(di,m) <iex (d 2 ,n 2 ) iff di □ d 2 or (di = d 2 and m < n 2 ). 

We use here the inverse ordering □ defined by: d\ □ d 2 iff d 2 C d\ and d 2 ^ d\. 

Given a finite set G we denote by card G the number of its elements. By assump- 
tion all functions in F are inflationary so, by virtue of assumption B, with each 
while loop iteration of the modified algorithm the pair 

(d, card G) 

strictly decreases in this ordering <i ex . But by assumption (D, C ) is finite, so 
(D, □) is well-founded and consequently so is (D x A/", <i ex )- This implies termi- 
nation. □ 

In particular, we obtain the following conclusion. 

Corollary 2.5 (GI). Suppose that (D, C ) is a finite partial ordering with the 
least element _L. Let F be a finite set of monotonic and inflationary functions on 
D. Then every execution of the GI algorithm terminates and computes in d the 
least common fixpoint of the functions from F. 

In practice, we are not only interested that the update function is easy to compute 
but also that it generates small sets of functions. Therefore we show how the 
function update can be made smaller when some additional information about the 
functions in F is available. This will yield specialized versions of the GI algorithm. 
First we need the following simple concepts. 

Definition 2.6. Consider two functions /,jona set D. 

— We say that / and g commute if f(g(x)) — g(f(x)) for all x. 
— We call / idempotent if f(f(x)) = f(x) for all x. 
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— We call a function / on a partial ordering (D, C ) a closure if / is inflationary, 
monotonic and itempotent. □ 

Closures were studied in Gierz et al. [1980]. They play an important role in 
mathematical logic and lattice theory. We shall return to them in Section 4. 
The following result holds. 

Theorem 2.7 (Update). 

(i) If update(G , g , d) satisfies assumptions A, B and C, then so does the function 

update(G, g, d) — Idemp(g), 

where 

Idemp(g) = {g} if g is idempotent and otherwise Idemp(g) = 0. 

(ii) Suppose that for each g the set of functions Comm(g) from F is such that 
— g g" Comm(g), 

— each element ofComm(g) commutes withg. 

If update(G , g , d) satisfies assumptions A, B and C, then so does the function 

update(G, g, d) — Comm(g). 
PROOF. It suffices to establish in each case assumption A and C. Let 
A := {/ G F - G | f(d) = d A f(g(d)) ± g(d)}. 

(i) After introducing the GI algorithm we noted already that g $ A. So assumption 
A implies A C update(G, g, d) — {g} and a fortiori A C update(G, g, d) — Idemp(g). 

For assumption C it suffices to note that g(g(d)) ^ g(d) implies that g is not 
idempotent, i.e., that Idemp(g) = 0. 

(ii) Consider f E A. Suppose that / S Comm(g). Then f(g(d) — g(f(d)) = g(d) 
which is a contradiction. So / Comm(g). Consequently, assumption A implies 
A C update(G, g,d) — Comm(g). 

For assumption C it suffices to use the fact that g £ Comm(g). □ 

We conclude that given an instance of the GI algorithm that employs a specific 
update function, we can obtain other instances of it by using update functions 
modified as above. Note that both modifications are independent of each other and 
therefore can be applied together. 

In particular, when each function is idempotent and the function Comm satisfies 
the assumptions of (ii), then the following holds: if update(G, g, d) satisfies assump- 
tions A, B and C, then so does the function update(G, g, d) — (Comm(g) U {g})- 

3. COMPOUND DOMAINS 

In the applications we study the iterations are carried out on a partial ordering 
that is a Cartesian product of the partial ordcrings. So assume now that the partial 
ordering (D, C ) is the Cartesian product of some partial orderings (Di, C A, for 
i G [l-.n], each with the least element _Lj. So D = D\ x • • • x D n . 

Further, we assume that each function from F depends from and affects only 
certain components of D. To be more precise we introduce a simple notation and 
terminology. 
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Definition 3.1. Consider a sequence of partial ordcrings (D\, C |),...,(D„, En)- 

— By a scheme (on n) we mean a growing sequence of different elements from [l..n]. 

— Given a scheme s := z l7 . . ., i; on n we denote by (D s , C s ) the Cartesian product 
of the partial orderings {D i} . , C f ), for j e [1..Z]. 

— Given a function / on Z? s we say that / is with scheme s and say that / depends 
on i if i is an element of s. 

— Given an n-tuplc d := d\, . . ., d n from D and a scheme s := ii, . . ., i\ on n we 
denote by d[s] the tuple d^,.. .,di t . In particular, for j e [l..n] is the j-th 
element of d. □ 

Consider now a function / with scheme s. We extend it to a function / + from 
D to D as follows. Take d £ ZX We set 

/+(d) := e 

where e[s] = f{d[s\) ande[n — s] = d[n — s], and wheren — sis the scheme obtained 
by removing from 1, . . ., n the elements of s. We call / + the canonic extension of 
/ to the domain D. 

So f + {d\, . . ., d n ) = (ei, . . ., e n ) implies di = for any i not in the scheme s of /. 
Informally, we can summarize it by saying that / + does not change the components 
on which it does not depend. This is what we meant above by stating that each 
considered function affects only certain components of D. 

We now say that two functions, / with scheme s and g with scheme t, commute 
if the functions / + and g + commute. 

Instead of defining iterations for the case of the functions with schemes, we rather 
reduce the situation to the one studied in the previous section and consider, equiv- 
alently, the iterations of the canonic extensions of these functions to the common 
domain D. However, because of this specific form of the considered functions, we 
can use now a simple definition of the update function. More precisely, we have the 
following observation. 

Note 3.2 (Update). Suppose that each function in F is of the form /+ . Then 
the following function update satisfies assumptions A, B and C: 

update(G , g + , d) := {f + E F \ f depends on some i in s such that d[i] ^ g + (d)[i]}, 

where g is with scheme s. 

Proof. To deal with assumption A take a function /+ 6 F — G such that 
f + {d) = d. Then f + (e) = e for any e that coincides with d on all components that 
are in the scheme of /. 

Suppose now additionally that f + (g + (dj) ^ g + (d). By the above g + (d) is not 
such an e, i.e., g + (d) differs from d on some component i in the scheme of /. In 
other words, / depends on some i such that d[i] ^ g + (d)[i]. This i is then in the 
scheme of g and consequently /+ e update(G,g + , d). 

The proof for assumption B is immediate. 

Finally, to deal with assumption C it suffices to note that g + (g + (dj) ^ g + {d) 
implies g + (dj) ^ d, which in turn implies that g + € update(G,g + , d). □ 
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This, together with the GI algorithm, yields the following algorithm in which we 
introduced a variable d' to hold the value of g + (d), and used F := {/ | / + E F} 
and the functions with schemes instead of their canonic extensions to D. 

Generic Iteration Algorithm for Compound Domains (CD) 

d := (J_i, . . .,-L„); 
d! := d; 
G := F ; 
while G ± do 

choose jgG; suppose g is with scheme s; 

G:=G-{g}; 

d'[s] :=g(d[a]); 

G := GU {/ € F | / depends on some i in s such that ^ 
d[s] := rf'[s] 

od 

The following corollary to the GI Theorem 2.4 and the Update Note 3.2 sum- 
marizes the correctness of this algorithm. It corresponds to Theorem 11 of Apt 
[1999a] where the iteration algorithms were introduced immediately on compound 
domains. 

Corollary 3.3 (CD). Suppose that (D, C ) is a finite partial ordering that is 
a Cartesian product of n partial orderings, each with the least element _U with 
i G [l..n]. Let F be a finite set of functions on D, each of the form f + . 

Suppose that all functions in F are monotonic and inflationary. Then every exe- 
cution of the CD algorithm terminates and computes in d the least common fixpoint 
of the functions from F. 

In the subsequent presentation we shall deal with the following two modifications 
of the CD algorithm: 

— CDI algorithm. This is the version of the CD algorithm in which all the functions 
are idempotent and the function update defined in the Update Theorem 2.7(i) is 
used. 

— CDC algorithm. This is the version of the CD algorithm in which all the functions 
are idempotent and the combined effect of the functions update defined in the 
Update Theorem 2.7 is used for some function Comm. 

For both algorithms the counterparts of the CD Corollary 3.3 hold. 

4. FROM PARTIAL ORDERINGS TO CONSTRAINT SATISFACTION PROBLEMS 

We have been so far completely general in our discussion. Recall that our aim is to 
derive various constraint propagation algorithms. To be able to apply the results of 
the previous section we need to relate various abstract notions that we used there 
to constraint satisfaction problems. 

This is perhaps the right place to recall the definition and to fix the notation. 
Consider a finite sequence of variables X := xi, . . ., x n , where n > 0, with respective 
domains V := D\, . . .,D n associated with them. So each variable Xi ranges over 
the domain Di. By a constraint C on X we mean a subset of D\ x . . . x D n . 

ACM Transactions on Programming Languages and Systems, Vol. TBD, No. TDB, Month Year. 



The Role of Commutativity in Constraint Propagation Algorithms • 11 



By a constraint satisfaction problem, in short CSP, we mean a finite sequence of 
variables X with respective domains T>, together with a finite set C of constraints, 
each on a subsequence of X. We write it as (C ; x\ G D\,...,x n G D n ), where 
X := xi, . . ., x n and T> := D\, . . .,D n . 

Consider now an element d := d\, . . ., d n of D\ x ... x D n and a subsequence 
Y := Xi t , . . ., Xi e of X. Then wc denote by d[Y] the sequence di t , . . .,di e . 

By a solution to (C ; x\ G Di, . . ., x n G D n ) we mean an element d G D\ x. . .xD n 
such that for each constraint C G C on a sequence of variables Y we have d[Y] G C. 
We call a CSP consistent if it has a solution. Two CSP's V\ and V2 with the same 
sequence of variables are called equivalent if they have the same set of solutions. 
This definition extends in an obvious way to the case of two CSP's with the same 
sets of variables. 

Let us return now to the framework of the previous section. It involved: 

(i) Partial orderings with the least elements; 

These will correspond to partial orderings on the CSP's. In each of them 
the original CSP will be the least element and the partial ordering will be 
determined by the local consistency notion wc wish to achieve. 

(ii) Monotonic and inflationary functions with schemes; 

These will correspond to the functions that transform the variable domains or 
the constraints. Each function will be associated with one or more constraints. 

(iii) Common fixpoints; 

These will correspond to the CSP's that satisfy the considered notion of local 
consistency. 

Let us be now more specific about items (i) and (ii). 
Rc: (i) 

To deal with the local consistency notions considered in this paper we shall 
introduce two specific partial orderings on the CSP's. In each of them the considered 
CSP's will be defined on the same sequences of variables. 

We begin by fixing for each set D a collection T{D) of the subsets of D that 
includes D itself. So T is a function that given a set D yields a set of its subsets 
to which D belongs. 

When dealing with the notion of hyper-arc consistency T(D) will be simply the 
set V(D) of all subsets of D but for specific domains only specific subsets of D will 
be chosen. For example, to deal with the the constraint propagation for the linear 
constraints on integer interval domains we need to choose for J-(D) the set of all 
subintervals of the original interval D. 

When dealing with the path consistency, for a constraint C the collection J-(C) 
will be also the set V(C) of all subsets of C . However, in general other choices may 
be needed. For example, to deal with the cutting planes method, we need to limit 
our attention to the sets of integer solutions to finite sets of linear inequalities with 
integer coefficients (see Apt [1999a, pages 193-194]). 

Next, given two CSP's, <f> := (C ; x\ G D\, . . .,x n G D n ) and tp := (C ; x\ G 
D[,...,x n G D' n ), we write 4> C d ip iff 

— D[ G T(Di) (and hence D[ C Di) for i G [l..n], 
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— the constraints in C are the restrictions of the constraints in C to the domains 
D[,...,D' n . 

Next, given two CSP's, <f>:=(C u .. ., C k ; V£) and ip:=(C[,.. ., C' k ; T>£), we 
write <j> C c ip iff 

—C[ G ^(Cj) (and hence C Cj) for i G [l..k]. 

In what follows we call Qd the domain reduction ordering and C c the constraint 
reduction ordering. To deal with the arc consistency, hyper-arc consistency and 
directional arc consistency notions we shall use the domain reduction ordering, and 
to deal with path consistency and directional path consistency notions we shall use 
the constraint reduction ordering. 

We consider each ordering with some fixed initial CSP V as the least element. 
In other words, each domain reduction ordering is of the form 

and each constraint reduction ordering is of the form 

({V'\VQ C V},Q C ). 

Re: (ii) 

The domain reduction ordering and the constraint reduction ordering arc not 
directly amenable to the analysis given in Section 3. Therefore, we shall rather use 
equivalent partial orderings defined on compound domains. To this end note that 
(C ; Xl G D[, ...,x n G D' n ) n d (C ; Xl G D'{, ...,x n G E%) iff D\ D Lf/ for i G 

[1 - n] : 

This equivalence means that for V = (C ; x\ G D±, . . .,x n G D n ) we can identify 
the domain reduction ordering ({V | V Ed V}, Ed) with the Cartesian product of 
the partial orderings {F{Di), D), where i G [l..n]. 

Additionally, each CSP in this domain reduction ordering is uniquely determined 
by its domains and by the initial V . Indeed, by the definition of this ordering the 
constraints of such a CSP are restrictions of the constraints of V to the domains of 
this CSP. 

Similarly, 

(Ci,.. ., C' k ; V£) C c (C'{, . . ., C'l ; V£) iff C[ D C'( for % G [l..fc]. 

This allows us for V = (Ci,...,Ck ; T>£) to identify the constraint reduction 
ordering ({V \ V E c V'}, Q c ) with the Cartesian product of the partial orderings 
(J-"(Ci),3), where i G [l..k]. Also, each CSP in this constraint reduction ordering 
is uniquely determined by its constraints and by the initial V . 

In what follows instead of the domain reduction ordering and the constraint re- 
duction ordering we shall use the corresponding Cartesian products of the partial 
orderings. So in these compound orderings the sequences of the domains (respec- 
tively, of the constraints) are ordered componentwise by the reversed subset ordering 
D. Further, in each component ordering {F(D), the set D is the least element. 

The reason we use these compound orderings is that we can now employ functions 
with schemes, as used in Section 3. Each such function / is defined on a sub- 
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Cartesian product of the constituent partial orderings. Its canonic extension /+, 
introduced in Section 3, is then defined on the "whole" Cartesian product. 

Suppose now that we are dealing with the domain reduction ordering with the 
least (initial) CSP V and that 

/+(£>! x ■ £>„) = £>Jx-"XD;. 

Then the sequence of the domains (A, ■ • ■, A) and V uniquely determine a CSP in 
this ordering and the same for (D[, . . ., D' n ) and V . Hence /+, and a fortiori /, can 
be viewed as a function on the CSP's that are elements of this domain reduction 
ordering. In other words, / can be viewed as a function on CSP's. 

The same considerations apply to the constraint reduction ordering. We shall use 
these observations when arguing about the equivalence between the original and 
the final CSP's for various constraint propagation algorithms. 

The considered functions with schemes will be now used in presence of the com- 
ponentwise ordering D. The following observation will be useful. 

Consider a function / on some Cartesian product !F{E\) x . . . x T(E m ). Note 
that / is inflationary w.r.t. the componentwise ordering D if for all (X\, . . ., X m ) e 
T{E{) x ... x T{E m ) we have Y t C X { for all i G [l..m], where f(X\, . . .,X m ) = 
(Yi , . . ., Y m ). 

Also, / is monotonic w.r.t. the componentwise ordering D if for all (X\, . . ., X m ), 
{X[, . . .,X' m ) G F{Ei) x ... x T{E m ) such that X t C X[ for all i G [l..m], the 
following holds: if 

fiX,, . . .,X m ) = (y l5 . . ., Y ro ) and f(X[, . . .,X'J = (Y{, . . , Y^), 

then Yi C Y- for all i G [l..m]. 

In other words, / is monotonic w.r.t. D iff it is monotonic w.r.t. C. This reversal 
of the set inclusion of course does not hold for the inflationarity notion. 

Let us discuss now briefly the functions used in our considerations. In the pre- 
ceding sections we clarified which of their properties account for specific properties 
of the studied algorithms. It is tempting then to confine one's attention to closures, 
i.e., functions that are inflationary, monotonic and itempotent. The importance of 
closures for concurrent constraint programming was recognized by Saraswat, Ri- 
nard and Panangaden [1991] realized and for the study of constraint propagation 
by Benhamou and Older [1997]. 

However, as shown in Apt [1999a], some known local consistency notions are 
characterized as common fixpoints of functions that in general are not itempotent. 
Therefore when studying constraint propagation in full generality it is preferrablc 
not to limit one's attention to closures. On the other hand, in the sections that 
follow we only study notions of local consistency that are characterized by means 
of closures. Therefore, from now on the closures will be prominently present in our 
exposition. 

5. A HYPER-ARC CONSISTENCY ALGORITHM 

We begin by considering the notion of hyper-arc consistency of Mohr and Masini 
[1988] (we use here the terminology of Marriott and Stuckey [1998]). The more 
known notion of arc consistency of Mackworth [1977] is obtained by restricting 
one's attention to binary constraints. Let us recall the definition. 
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Definition 5.1. 

— Consider a constraint C on the variables x\, . . .,x n with the respective domains 
Di, . . ., D n , that is C C x ■ • • x D n . We call C hyper- arc consistent if for every 
i G [l..n] and a G there exists d G C such that a = d\i}. 

— We call a CSP hyper-arc consistent if all its constraints are hyper-arc consistent. 
□ 

Intuitively, a constraint C is hyper-arc consistent if for every involved domain 
each element of it participates in a solution to C. 

To employ the CDI algorithm of Section 3 we now make specific choices involving 
the items (i), (ii) and (iii) of the previous section. 

Rc: (i) Partial ordcrings with the least elements. 

As already mentioned in the previous section, for the function T we choose the 
powerset function V, so for each domain D we put J-(D) := V(D). 

Given a CSP V with the sequence D\, . . ., D n of the domains we take the domain 
reduction ordering with V as its least element. As already noted we can identify 
this ordering with the Cartesian product of the partial orderings (V(Di) 7 D), where 
i G [l..n]. The elements of this compound ordering are thus sequences (X±, . . ., X n ) 
of respective subsets of the domains Di, . . ., D n ordered componentwise by the 
reversed subset ordering D. 

Re: (ii) Monotonic and inflationary functions with schemes. 

Given a constraint C on the variables yi, ■ ■ -,y k with respective domains E\ , . . ., E k , 
we abbreviate for each j G [l..k] the set {d[j} d G C} to IL;(C). Thus rij(C) con- 
sists of all j-th coordinates of the elements of C. Consequently, IL. (C) is a subset 
of the domain Ej of the variable yj . 

We now introduce for each i G [l..fc] the following function m on V(Ei) x • • • x 

v(E k y. 

Ki(Xi, . . .,X k ) := (Xi, . . ., Xi-i, X^ . . ., X k ) 

where 

i,':=n,(cn(i 1 x ■■■xXfc)). 

That is, X[ = {d[i} \ d G X\ x • • • x X k and d G C}. Each function m is associated 
with a specific constraint C. Note that X[ CX^ so each function Wi boils down to 
a projection on the i-th component. 

Re: (iii) Common fixpoints. 

Their use is clarified by the following lemma that also lists the relevant properties 
of the functions 7Tj (see Apt [1999a, pages 197 and 202]). 

Lemma 5.2 (Hyper- arc Consistency). 

(i) A CSP (C ; xi € Di, . . .,x n G D n ) is hyper-arc consistent iff (Di, . . .,D n ) is a 
common fixpoint of all functions 7r+ associated with the constraints from, C. 

(ii) Each projection function iTi associated with a constraint C is a closure w.r.t. 
the componentwise ordering D. 

By taking into account only the binary constraints we obtain an analogous char- 
acterization of arc consistency. The functions tt\ and 7r 2 can then be defined more 
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directly as follows: 

n,(X,Y) := (X',Y), 

where X' := {a e X \ 3b e Y (a, b) G C}, and 

7r 2 (X,y) := (X 7 Y'), 

where F' := {fe e Y \ 3a e X (a, b) G C}. 

Fix now a CSP V. By instantiating the CDI algorithm with 

F := {/ | / is a 7Tj function associated with a constraint of P} 

and with each _L, equal to Di we get the HYPER-ARC algorithm that enjoys following 
properties. 

Theorem 5.3 (HYPER-ARC Algorithm). Consider a CSP V := (C ; x\ G 
£>i, . . G D n )> w/iere each Di is finite. 

The HYPER-ARC algorithm always terminates. Let V 1 be the CSP determined by 
V and the sequence of the domains D[, . . ., D' n computed in d. Then 

(i) V' is the Qd-least CSP that is hyper-arc consistent, 

(ii) V' is equivalent to V . 

Due to the definition of the C. d ordering the item (i) can be rephrased as follows. 
Consider all hyper-arc consistent CSP's that are of the form (C ; X\ G D[, . . ., x n G 
D' n ) where D[ C Di for i G [l..n] and the constraints in C are the restrictions of 
the constraints in C to the domains D[, . . .,D' n . Then among these CSP's V has 
the largest domains. 

Proof. The termination and (i) are immediate consequences of the counterpart 
of the CD Corollary 3.3 for the CDI algorithm and of the Hyper-arc Consistency 
Lemma 5.2. 

To prove (ii) note that the final CSP V' can be obtained by means of repeated 
applications of the projection functions 7r, starting with the initial CSP V. (Con- 
forming to the discussion at the end of Section 4 we view here each such function 
as a function on CSP's). As noted in Apt [1999a, pages 197 and 201]) each of these 
functions transforms a CSP into an equivalent one. □ 

6. AN IMPROVEMENT: THE AC-3 ALGORITHM 

In the HYPER-ARC algorithm each time a Hi function associated with a constraint 
C on the variables y\,...,yk is applied and modifies its arguments, all projection 
functions associated with a constraint that involves the variable are added to 
the set G. In this section we show how we can exploit an information about the 
commutativity to add less projection functions to the set G. Recall that in Section 
3 we modified the notion of commutativity for the case of functions with schemes. 

First, it is worthwhile to note that not all pairs of the 7r^ and irj functions com- 
mute. 

Example 6.1. 

(i) We consider the case of two binary constraints on the same variables. Consider 
two variables, x and y with the corresponding domains D x := {a, b}, D y := {c,d} 
and two constraints on x, y: C\ :— {(a,c), (b,d)} and C2 := {(a, d)}. 
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Next, consider the 7Ti function of C\ and the 7r 2 function of Ci. Then apply- 
ing these functions in one order, namely 7r 2 7ri, to (D x ,D y ) yields D x unchanged, 
whereas applying them in the other order, 7ri7r 2 , yields D x equal to {b}. 

(ii) Next, we show that the commutativity can also be violated due to sharing of 
a single variable. As an example take the variables x, y, z with the corresponding 
domains D x := {a, 6}, D y := {&}, D z := {c, d}, and the constraint C\ :— {(a, b)} 
on x, y and C 2 := {(a, c), (b, d)} on x, z. 

Consider now the -k\ function of C\ and the function of C 2 . Then applying 
these functions in one order, namely n^n^, to (D x , D y , D z ) yields D z equal to {c}, 
whereas applying them in the other order, tt^-k^ , yields D z unchanged. □ 

The following lemma clarifies which projection functions do commute. 

Lemma 6.2 (Commutativity). Consider a CSP and two constraints of it, C 
on the variables yi, . . ., yu and E on the variables z\,...,zt. 

(i) For i, j G [l..k] the functions Hi and ttj of the constraint C commute. 

(ii) If the variables yi and Zj are identical then the functions iri of C and nj of E 
commute. 

Proof. See Appendix. □ 

Fix now a CSP. We derive a modification of the HYPER-ARC algorithm by instan- 
tiating this time the CDC algorithm. As before we use the set of functions 

'■= {/ I / is a Ti function associated with a constraint of V} 

and each _U equal to Di. Additionally we employ the following function Comm, 
where Wi is associated with a constraint C and where E differs from C: 

Comm(-Ki) :— {nj \ i ^ j and nj is associated with the constraint C} 
U {iTj | 7Tj is associated with a constraint E and 

the i-th variable of C and the j-th variable of E coincide}. 

By virtue of the Commutativity Lemma 6.2 each set Comm(g) satisfies the as- 
sumptions of the Update Theorem 2.7(H). 

By limiting oneself to the set of functions 7Ti and 7r 2 associated with the binary 
constraints, we obtain an analogous modification of the corresponding arc consis- 
tency algorithm. 

Using now the counterpart of the CD Corollary 3.3 for the CDC algorithm we 
conclude that the above algorithm enjoys the same properties as the HYPER-ARC 
algorithm, that is the counterpart of the HYPER-ARC Algorithm Theorem 5.3 holds. 

Let us clarify now the difference between this algorithm and the HYPER-ARC 
algorithm when both of them are limited to the binary constraints. 

Assume that the considered CSP is of the form (C ; V£). We reformulate the 
above algorithm as follows. Given a binary relation R, we put 

R T := {(b,a) | (a, b) e R}. 

For F we now choose the set of the 7Ti functions of the constraints or relations 
from the set 
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So := {C | C is a binary constraint from C} 
U {C T | C is a binary constraint from C}. 

Finally, for each 7Ti function of some C G So on x, y we define 

Comm{-Ki) := {the m function of C T } 

U {/ | / is the 7Ti function of some E G So on x, z where z ^ y}. 

Assume now that 

for each pair of variables x, y at most one constraint exists on x, y. (1) 

Consider now the corresponding instance of the CDC algorithm. By incorporating 
into it the effect of the functions iri on the corresponding domains, we obtain the 
following algorithm known as the AC-3 algorithm of Mackworth [1977]. 

We assume here that V£ := x\ G D\, . . .,x n G D n . 

AC-3 Algorithm 

So := {C | C is a binary constraint from C} 

U {C T | C is a binary constraint from C}; 
S := S ; 
while S ^ do 

choose C G S; suppose C is on x i7 xf, 
Di := {a G A I 3 b G (a, 6) G C}; 
if A changed then 

S := S U {C G So | C is on the variables y, Xi where y ^ Xj} 

fi; 

S := S- {C} 

od 

It is useful to mention that the corresponding reformulation of the HYPER-ARC 
algorithm for binary constraints differs in the second assignment to S which is then 

S := S U {C G So | C is on the variables y, z where y is Xi or z is Xi}. 

So we "capitalized" here on the commutativity of the corresponding projection 
functions 7Ti as follows. First, no constraint or relation on Xi, z for some z is added 
to S. Here we exploited part (ii) of the Commutativity Lemma 6.2. 

Second, no constraint or relation on Xj, Xi is added to S. Here we exploited part 
(i) of the Commutativity Lemma 6.2, because by assumption (1) C T is the only 
constraint or relation on Xj , Xi and its 7Ti function coincides with the 7T2 function 
of C. 

In case assumption (1) about the considered CSP is dropped, the resulting al- 
gorithm is somewhat less readable. However, once we use the following modified 
definition of Comm{-Ki): 

Commit) :={/|/ is the -k\ function of some E G So on x, z where z ^ y} 

we get an instance of the CDC algorithm which differs from the AC-3 algorithm in 
that the qualification "where y ^ xj" is removed from the definition of the second 
assignment to the set S. 
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To illustrate the considerations of this section let us return now to the crossword 
puzzle introduced in Subsection 1.2. 

As pointed out by Mackworth [1992] this problem can be easily formulated as a 
CSP as follows. First, associate with each position i E [1..8] in the grid of Figure 
1 a variable. Then associate with each variable the domain that consists of the set 
of words that can be used to fill this position. For example, position 6 needs to 
be filled with a three letter word, so the domain of the variable associated with 
position 6 consists of the above set of five 3 letter words. 

Finally, we define constraints. They deal with the restrictions arising from the 
fact that the words that cross share a letter. For example, the crossing of the 
positions 1 and 2 contributes the following constraint: 

C 12 : = {(HOSES, SAILS), (HOSES, SHEET), (HOSES, STEER), 
(LASER, SAILS), (LASER, SHEET), (LASER, STEER)} . 

This constraint formalizes the fact that the third letter of position 1 needs to be 
the same as the first letter of position 2. In total there are twelve constraints. 

Each projection function m associated with a constraint C or its transpose C T 
corresponds to a crossing, for example (8,2). It removes impossible values from the 
current domain of the variable associated with the first position, here 8. 

The above Commutativity Lemma 6.2 allows us to conclude that for any pairwise 
different a,b,c £ [1--8] the projection functions iri associated with the crossings 
(a, b) and (b, a) commute and also the projection functions ni associated with the 
crossings (a, b) and (a, c) commute. This explains why in the AC-3 algorithm applied 
to this CSP after considering a crossing (a, b), for example (2,4), neither the crossing 
(4,2) nor the crossings (2,7) and (2,8) are added to the set of examined crossings. 

To see that the AC-3 algorithm applied to this CSP yields the unique solution 
depicted in Figure 2 it is sufficient to observe that this solution viewed as a CSP is 
arc consistent and that it is obtained by a specific execution of the AC-3 algorithm, 
in which the crossings are considered in the following order: 

(1,2), (2,1), (1,3), (3,1), (4,2), (2,4), (4,5), (5,4), (4,2), (2,4), 
(7,2), (2,7), (7,5), (5,7), (8,2), (2,8), (8,6), (6,8), (8,2), (2,8). 

The desired conclusion now follows by the counterpart of the CD Corollary 3.3 
according to which every execution of the AC-3 algorithm yields the same outcome. 

7. A PATH CONSISTENCY ALGORITHM 

The notion of path consistency was introduced in Montanari [1974]. It is defined 
for special type of CSP's. For simplicity we ignore here unary constraints that are 
usually present when studying path consistency. 

Definition 7.1. We call a CSP V standardized if for each pair x, y of its variables 
there exists exactly one constraint on x, y in V . We denote this constraint by C x>y . 
□ 

Every CSP is trivially equivalent to a standardized CSP. Indeed, it suffices for 
each pair x,y of the variables of V first to add the "universal" constraint on x,y 
that consists of the Cartesian product of the domains of the variables x and y and 
then to replace the set of all constraints on x, y by their intersection. 
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At the cost of some notational overhead our considerations about path consis- 
tency can be generalized in a straightforward way to the case of CSP's such that for 
each pair of variables x,y at most one constraint exists on x, y, i.e., to the CSP's 
that satisfy assumption (1). 

To simplify the notation given two binary relations R and S we define their 
composition • by 

R ■ S := {(a, b) | 3c ((a, c) G R, (c, b) G S)}. 

Note that if R is a constraint on the variables x, y and S a constraint on the 
variables y, z, then R ■ S is a constraint on the variables x, z. 

Given a subsequence x, y of two variables of a standardized CSP we introduce a 
"supplementary" relation C VtX defined by 

r •— r T 

^y,x ■— ^x,y 

Recall that the relation C T was introduced in the previous section. The supple- 
mentary relations are not parts of the considered CSP as none of them is defined 
on a subsequence of its variables, but they allow us a more compact presentation. 
We now introduce the following notion. 

Definition 7.2. We call a standardized CSP path consistent if for each subset 
{x, y, z} of its variables we have 

□ 

In other words, a standardized CSP is path consistent if for each subset {x, y, z) 
of its variables the following holds: 

if (a, c) G C x ,zj then there exists b such that (a, b) G C x . y and (6, c) G C y ^ z . 

To employ the CDI algorithm of Section 3 we again make specific choices in- 
volving the items (i), (ii) and (iii) of Section 4. First, we provide an alternative 
characterization of path consistency. 

Note that in the above definition we used the relations of the form C u , v for any 
subset {u, v} of the considered sequence of variables. If u, v is not a subsequence 
of the original sequence of variables, then C UiV is a supplementary relation that is 
not a constraint of the original CSP. At the expense of some redundancy we can 
rewrite the above definition so that only the constraints of the considered CSP are 
involved. This is the contents of the following simple observation that will be useful 
in a moment. 

Note 7.3 (Alternative Path Consistency). A standardized CSP is path con- 
sistent iff for each subsequence x, y, z of its variables we have 

c c c . n T 

Cy, Z C C^y ■ C XiZ - 
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Figure 3 clarifies this observation. For instance, an indirect path from x to y via 
z requires the reversal of the arc (y, z). This translates to the first formula. 



y 




X (-1 z 



Fig. 3. Three relations on three variables 

Now, to study path consistency, given a standardized CSP V := (C\ , . . ., Ck ; T>£) 
we take the constraint reduction ordering of of Section 4 with V as the least element 
and with the powerset function as the function T . So, as already noted in Section 
4 we can identify this ordering with the Cartesian product of the partial orderings 
(P(Ci),2)) where i £ [l..fc]. The elements of this compound ordering are thus 
sequences (X\, . . ., X^) of respective subsets of the constraints Ci , . . ., Ck ordered 
componentwise by the reversed subset ordering D. 

Next, given a subsequence x, y, z of the variables of V we introduce three functions 
on V(C XtV ) x V(C X<Z ) x P(C VlZ ): 

fl v (P,Q,R) := (P',Q,R), 

where P' := P n Q ■ R T , 

fl z (P,Q,R) := (P,Q',R), 

where Q' := Q n P ■ R, and 

fl z {P,Q,R) := (P,Q,R'), 

where R' := R n P T • Q. 

In what follows, when using a function /J we implicitly assume that the variables 
x,y,z are pairwise different and that x,y is a subsequence of the variable of the 
considered CSP. 

Finally, we relate the notion of path consistency to the common fixpoints of the 
above defined functions. This leads us to the following counterpart of the Hyper-arc 
Consistency Lemma 5.2. 

Lemma 7.4 (Path Consistency). 

(i) A standardized CSP (Ci,...,Cfc ; T>£) is path consistent iff (Ci, . . ., Ck) is a 
common fixpoint of all functions (f^ y ) + , and (fy tZ ) + associated with 
the subsequences x, y, z of its variables. 

(ii) The functions f* y , f% and f* z are closures w.r.t. the componentwise ordering 
2- 
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PROOF, (i) is a direct consequence of the Alternative Path Consistency Note 7.3. 
The proof of (ii) is straightforward. These properties of the functions , f% and 
fy Z were already mentioned in Apt [1999a, page 193]. □ 

We now instantiate the CDI algorithm with the set of functions 

F := {/ | x, y, z is a subsequence of the variables of V and / G {f£ y , f% z , fy, z }}> 

n := k and each _Lj equal to Cj. 

Call the resulting algorithm the PATH algorithm. It enjoys the following proper- 
ties. 

Theorem 7.5 (PATH Algorithm). Consider a standardized CSP 
V := (Ci, . . ., Cfc ; Assume i/iai each constraint C'i is finite. 

The PATH algorithm always terminates. Let V' := (CJ, . ■■,C' k ; where the 

sequence of the constraints C[, . . .,C' k is computed in d. Then 

(i) V is the ^ c -least CSP that is path consistent, 

(ii) V' is equivalent to V . 

As in the case of the HYPER-ARC Algorithm Theorem 5.3 the item (i) can be 
rephrased as follows. Consider all path consistent CSP's that are of the form 
{C[,...,C' k ; V£) where C[ C C, for i e [l..fc]. Then among them V has the 
largest constraints. 

PROOF. The proof is analogous to that of the HYPER-ARC Algorithm Theorem 
5.3. The termination and (i) are immediate consequences of the counterpart of the 
CD Corollary 3.3 for the CDI algorithm and of the Path Consistency Lemma 7.4. 

To prove (ii) we now note that the final CSP V' can be obtained by means of 
repeated applications of the functions f^ y , f% z and fy Z starting with the initial 
CSP V. (Conforming to the discussion at the end of Section 4 we view here each 
such function as a function on CSP's). As noted in Apt [1999a, pages 193 and 195]) 
each of these functions transforms a CSP into an equivalent one. □ 

8. AN IMPROVEMENT: THE PC-2 ALGORITHM 

In the PATH algorithm each time a function is applied and modifies its argu- 
ments, all functions associated with a triplet of variables including x and y are 
added to the set G. We now show how we can add less functions by taking into 
account the commutativity information. To this end we establish the following 
lemma. 

Lemma 8.1 (Commutativity). Consider a standardized CSP involving among 
others the variables x, y, z, u. Then the functions f* y and f£ y commute. 

In other words, two functions with the same pair of variables as a subscript 
commute. 

PROOF (Sketch). The following intuitive argument may help to understand 
the more formal justification given in Appendix. First, both considered functions 
have three arguments but share precisely one argument, the one from P(C x . y ), and 
modify only this shared argument. Second, both functions are defined in terms of 
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the set-theoretic intersection operation "fl" applied to two, unchanged, arguments. 
This yields commutativity since "fl" is commutative. □ 

Fix now a standardized CSP V. We instantiate the CDC algorithm with the same 
set of functions F as in Section 7. Additionally, we use the following function 
Coram: 

Comm(fl y ) = {fly | u ft {x,y, z}}. 

Thus for each function g the set Comm(g) contains precisely m — 3 elements, 
where m is the number of variables of the considered CSP. This quantifies the 
maximal "gain" obtained by using the commutativity information: at each "up- 
date" stage of the corresponding instance of the CDC algorithm we add up to m — 3 
less elements than in the case of the corresponding instance of the CDI algorithm 
considered in the previous section. 

By virtue of the Commutativity Lemma 8.1 each set Comm(g) satisfies the as- 
sumptions of the Update Theorem 2.7(H). We conclude that the above instance 
of the CDC algorithm enjoys the same properties as the original PATH algorithm, 
that is the counterpart of the PATH Algorithm Theorem 7.5 holds. To make this 
modification of the PATH algorithm easier to understand we proceed as follows. 

Below we write x ~< y to indicate that x, y is a subsequence of the variables of the 
CSP V . Each function of the form /" where x -< y and u £ {x, y} can be identified 
with the sequence x,u,y of the variables. (Note that the "relative" position of u 
w.r.t. x and y is not fixed, so x,u,y does not have to be a subsequence of the 
variables of V '.) This allows us to identify the set of functions F with the set 

Vo := {(x, u,y)\x <y,u(£ {x, y}}. 

Next, assuming that x -< y, we introduce the following set of triples of different 
variables of V: 

V XtV := {(x, y,u) \ x<u}\J {(y, x,u)\y <u} 
U {(u,x,y) u -< y} U {(u,y,x) | u < x). 

Informally, V XtV is the subset of Vq that consists of the triples that begin or end 
with either x,y or y,x. This corresponds to the set of functions in one of the 
following forms: /«„, f* u , f^ y and f^ x . 

The above instance of the CDC algorithm then becomes the following PC-2 algo- 
rithm of Mackworth [1977]. Here initially E x , y = C XtV . 

PC-2 Algorithm 

V := {(x, u,y)\x -<y,u<£ {x, y}}; 
V := V a ; 
while V ^ do 

choose peF; suppose p = (x, u, y); 

apply /" to its current domains; 

if E x y changed then 
V :=VUV x , y] 

A; 

V := V - {p} 

od 
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Here the phrase "apply /" to its current domains" can be made more precise if 
the "relative" position of u w.r.t. x and y is known. Suppose for instance that u is 
"before" x and y. Then f£ y is defined on V(C UjX ) x V(C U)V ) x V{C x . y ) by 

fx,y(J^u,xi E u ,yi E x> y) . {E u x , E uyi E X y PI E ux ■ E U y), 

so the above phrase "apply /" to its current domains" can be replaced by the 
assignment 

E — E n E T ■ E 

Analogously for the other two possibilities. 

The difference between the PC-2 algorithm and the corresponding representation 
of the PATH algorithm lies in the way the modification of the set V is carried out. 
In the case of the PATH algorithm the second assignment to V is 

V := V U V XtV U {(*, u, y) \ u £ {x, y}}. 
9. SIMPLE ITERATION ALGORITHMS 

Let us return now to the framework of Section 2. We analyze here when the while 
loop of the Generic Iteration Algorithm GI can be replaced by a for loop. 
First, we weaken the notion of commutativity as follows. 

Definition 9.1. Consider a partial ordering (D, E ) and functions / and g on D. 
We say that / semi-commutes with g (w.r.t. C ) if f(g(x)) □ g(f(x)) for all x. □ 

The following lemma provides an answer to the question just posed. Here and 
elsewhere we omit brackets when writing repeated applications of functions to an 
argument. 

Lemma 9.2 (Simple Iteration). Consider a partial ordering (D, C ) with the 
least element _L. Let F := /i, . . ., fk be a finite sequence of closures on (D, C ). 
Suppose that semi-commutes with fj for i > j, that is, 

fifj(x) E fjfi(x) for i > j and for all x. (2) 

Then fxfi- ■ -/fe(-L) is the least common fixpoint of the functions from F. 

Proof. We prove first that for i e [l..k] we have 

/i/i/ 2 .../fc(-L) E /i/ 2 .../fc(-L). 

Indeed, by the assumption (2) we have the following string of inclusions, where the 
last one is due to the idempotence of the considered functions: 

fihf 2 . . ./ fc (_L) C fifih- • ./fc(-L) E • • • E /1/2. • ./i/i. • ./fc(-L) E /1/2. • .A(-L). 
Additionally, by the inflationarity of the considered functions, we also have for 

i e [i..fc] 

/i/ 2 .../fc(-L) E /i/i/ 2 .../fc(-L). 

So /i/ 2 . . -/fe(-L) is a common fixpoint of the functions from F. This means 
that any iteration of F that starts with _L, /fe(-L), fk-ifk(-L), ■ . ., /i/ 2 . • -/fe(-L) 
eventually stabilizes at /i/ 2 . . ./fc(-L). By the Stabilization Lemma 2.3 we get the 
desired conclusion. □ 
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The above lemma provides us with a simple way of computing the least common 
fixpoint of a finite set of functions that satisfy the assumptions of this lemma, in 
particular condition (2). Namely, it suffices to order these functions in an appro- 
priate way and then to apply each of them just once, starting with the argument 
_L. 

The following algorithm is a counterpart of the GI algorithm. We assume in it 
that condition (2) holds for the sequence of functions /i, . . ., /fe. 

Simple Iteration Algorithm (SI) 

d := T; 

for i := k to 1 by — 1 do 

d:=fi(d) 

od 

The following immediate consequence of the Simple Iteration Lemma 9.2 is a 
counterpart of the GI Corollary 2.5. 

Corollary 9.3 (SI). Suppose that (D, C ) is a partial ordering with the least 
element T. Let F := /i, . . ., fi- be a finite sequence of closures on (D, C ) such that 
(2) holds. Then the SI algorithm terminates and computes in d the least common 
fixpoint of the functions from F. 

Note that in contrast to the GI Corollary 2.5 we do not require here that the 
partial ordering is finite. We can view the SI algorithm as a specialization of the 
GI algorithm of Section 2 in which the elements of the set of functions G are selected 
in a specific way and in which the update function always yields the empty set. 

In Section 3 wc refined the GI algorithm for the case of compound domains. An 
analogous refinement of the SI algorithm is straightforward and omitted. In the 
next two sections we show how we can use this refinement of the SI algorithm to 
derive two well-known constraint propagation algorithms. 

10. DAC: A DIRECTIONAL ARC CONSISTENCY ALGORITHM 

We consider here the notion of directional arc consistency of Dechter and Pearl 
[1988]. Let us recall the definition. 

Definition 10.1. Assume a linear ordering -< on the considered variables. 

— Consider a binary constraint C on the variables x, y with the domains D x and 
D y . We call C directionally arc consistent w.r.t. -<, if 
— Va E D x 3b E D y (a, b) £ C provided x -< y, 
— V& E D y 3a E D x (a, b) E C provided y < x. 

So out of these two conditions on C exactly one needs to be checked. 
— We call a CSP directionally arc consistent w.r.t. -< if all its binary constraints 
are directionally arc consistent w.r.t. -<,. □ 

To derive an algorithm that achieves this local consistency notion we first char- 
acterize it in terms of fixpoints. To this end, given a V and a linear ordering -< on 
its variables, we rather reason in terms of the equivalent CSP V-i, obtained from V 
by reordering its variables along -< so that each constraint in is on a sequence 
of variables x\,...,x n such that x\ -< x 2 -<...-< x n . 
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The following simple characterization holds. 

Lemma 10.2 (Directional Arc Consistency). Consider a CSP V with a 
linear ordering ~< on its variables. Let := (C ; x\ € D\, . . .,x n G D n ). Then V 
is directionally arc consistent w.r.t. -< iff (D\, . . ., D n ) is a common fixpoint of the 
functions tt^ associated with the binary constraints from . 

We now instantiate in an appropriate way the SI algorithm for compound do- 
mains with all the 7Ti functions associated with the binary constraints from V^. 
In this way we obtain an algorithm that achieves for V directional arc consis- 
tency w.r.t. -<. First, we adjust the definition of semi-commutativity to func- 
tions with different schemes. To this end consider a sequence of partial orderings 
{D\, C !),...,(£)„, C n ) and their Cartesian product (D, C ). Take two func- 
tions, / with scheme s and g with scheme t. We say that / semi-commutes with g 
(w.r.t. C ) if /+ semi-commutes with g + w.r.t. C , that is if 

f + (g + (d)) E 9 + (f + {d)) 

for all d e D. 

The following lemma is crucial. To enhance the readability, we replace here the 
irrelevant variables by _. 

Lemma 10.3 (Semi-commutativity). Consider a CSP and two binary con- 
straints of it, C\ on _, z and C2 on _, y, where y < z. 

Then the 7ri function of C\ semi-commutes with the m function 0/C2 w.r.t. the 
componentwise ordering D. 

Proof. See Appendix. □ 

To be able to apply this lemma we order appropriately the 7Ti functions of the 
binary constraints of V^. Namely, given two 7Ti functions, / associated with a 
constraint on _, z and g associated with a constraint on _, y, we put / before g if 
y -< z. Then by virtue of this lemma and the Commutativity Lemma 6.2(h) if 
the function / precedes the function g, then / semi-commutes with g w.r.t. the 
componentwise ordering D. 

Observe that we leave here unspecified the order between two 7Ti functions, one 
associated with a constraint on x, z and another with a constraint on y, z, for some 
variables x,y,z. Note that if x and y coincide then the semi-commutativity is 
indeed a consequence of the Commutativity Lemma 6.2(h). 

We instantiate now the refinement of the SI algorithm for the compound domains 
by the above-defined sequence of the 7Ti functions and each ±i equal to the domain 
Di of the variable X{. In this way we obtain the following algorithm, where the 
sequence of functions is /1, . . ., fk- 

Directional Arc Consistency Algorithm (DARC) 

d:= (Di,...,D n ); 

for j := k to 1 by — 1 do 

suppose fj is with scheme s; 

d[s] ~fM*]) 

od 
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This algorithm enjoys the following properties. 

Theorem 10.4 (DARC Algorithm). Consider a CSP V with a linear ordering 
-< on its variables. Let := (C ; x\ G A, . . ., x n G D n ). 

The DARC algorithm always terminates. Let V' be the CSP determined by and 
the sequence of the domains D[, . . ., D' n computed in d. Then 

(i) V is the \-d-least CSP in {V\ \ C d T^i} that is directionally arc consistent 
w.r.t. -<, 

(ii) V' is equivalent to V . 

Proof. The termination is obvious, (i) is an immediate consequences of the 
counterpart of the SI Corollary 9.3 for the SI algorithm refined for the compound 
domains and of the Directional Arc Consistency Lemma 10.2. 

The proof of (ii) is analogous to that of the HYPER-ARC Algorithm Theorem 
5.3(H). □ 

Note that in contrast to the HYPER- ARC Algorithm Theorem 5.3 we do not need 
to assume here that each domain is finite. 

Assume now that the original CSP V is standardized, i.e., for each pair of its 
variables x,y precisely one constraint on x,y exists. The same holds then for V~>. 
We now specialize the DARC algorithm by ordering the n\ functions in a deterministic 
way. Suppose that := (C ; x\ G D\, . . ., x n G D n ). Denote the unique constraint 
of on Xi, Xj by dj. 

Order now these constraints as follows: 

That is, the constraint Ci'ji precedes the constraint Ci"j" if the pair (j", i') lexico- 
graphically precedes the pair (j 1 , i"). Take now the tt\ functions of these constraints 
ordered in the same way as their constraints. 

The above DARC algorithm can then be rewritten as the following double for loop. 
The resulting algorithm is known as the DAC algorithm of Dechter and Pearl [1988]. 

for j := n to 2 by —1 do 
for i := 1 to j — 1 do 

A := {a G A | 3 b G Dj (a, b) G C i;j } 

od 

od 

11. DPC: A DIRECTIONAL PATH CONSISTENCY ALGORITHM 

In this section we deal with the notion of directional path consistency defined in 
Dechter and Pearl [1988]. Let us recall the definition. 

Definition 11.1. Assume a linear ordering on the considered variables. We 
call a standardized CSP directionally path consistent w.r.t. -< if for each subset 
{x, y, z} of its variables we have 

C x , z C C XjV ■ C VtZ provided x,z <y. 

□ 
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This definition relies on the supplementary relations because the ordering -< may 
differ from the original ordering of the variables. For example, in the original 
ordering z can precede x. In this case C z , x and not C XjZ is a constraint of the CSP 
under consideration. 

But just as in the case of path consistency we can rewrite this definition using the 
original constraints only. In fact, we have the following analogue of the Alternative 
Path Consistency Note 7.3. 

Note 11.2 (Alternative Directional Path Consistency). A standardized 
CSP is directionally path consistent w.r.t. ~< iff for each subsequence x,y,z of its 
variables we have 

C XyV C C XyZ ■ Cy Z provided x,y -< z, 
C XlZ C C x<y ■ C VtZ provided x,z -<y, 

Cy^ z C C^y ■ C x . z provided y,z ~< x. 

Thus out of the above three inclusions precisely one needs to be checked. 

As before we now characterize this local consistency notion in terms of fixpoints. 
To this end, as in the previous section, given a standardized CSP V we rather 
consider the equivalent CSP . The variables of are ordered according to -< 
and is standardized, as well. 

The following counterpart of the Directional Arc Consistency Lemma 10.2 is a 
direct consequence of the Alternative Directional Path Consistency Note 11.2. We 
use here the functions f? „ defined in Section 7. 

Lemma 11.3 (Directional Path Consistency). Consider a standardized 
CSP V with a linear ordering -< on its variables. Let := {C\ , . . . , C\ ; T>£). 
Then V is directionally path consistent w.r.t. -< iff(C\, . . ., C&) is a common fixpoint 
of all functions {f XtV ) + , where x -< y -< z. 

To obtain an algorithm that achieves directional path consistency we now instan- 
tiate in an appropriate way the SI algorithm. To this end we need the following 
lemma. 

Lemma 11.4 (Semi-COMMUTATIVITy). Consider a standardized CSP with a lin- 
ear ordering -< on its variables. Suppose that X\ -< y\ -< z, xi -< yi -< u and u < z. 
Then the function f* ± semi-commutes with the function /" 2 y2 w.r.t. the compo- 
nentwise ordering 3. 

Proof. See Appendix. □ 

Consider now a standardized CSP V with a linear ordering ~< on its variables 
and the corresponding CSP V^. To be able to apply the above lemma we order 
the functions, where x -< y ~< z, as follows. 

Assume that the sequence of the variables of V^, that is x\ < X2 -< 

. . . -< x n . Let for m G [3..n] the sequence L m consist of the functions f x ™ x ., where 
i < j < to, ordered in an arbitrary way. Consider the sequence resulting from 
appending the sequences L n , L n _\, . . ., L3, in that order. Then by virtue of the 
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Semi-commutativity Lemma 11.4 if the function / precedes the function <?, then / 
semi-commutes with g w.r.t. the componentwise ordering D. 

We instantiate now the refinement of the SI algorithm for the compound domains 
by the above-defined sequence of functions f£ y and each equal to the constraint 
Cj. This yields the Directional Path Consistency Algorithm (DPATH) that 
apart from the different choice of the constituent partial orderings is identical to the 
Directional Arc Consistency Algorithm DARC of the previous section. Con- 
sequently, the DPATH algorithm enjoys analogous properties as the DARC algorithm. 
They are summarized in the following theorem. 

Theorem 11.5 (DPATH Algorithm). Consider a standardized CSP V with a 
linear ordering -< on its variables. Let := {C\, ...,Ck T>£). 

The DPATH algorithm always terminates. Let V' := (C[, . . .,C' k ; T>£) , where the 
sequence of the constraints C[, . . ., C' k is computed in d. Then 

(i) V' is the \— c -least CSP in {V\ \ C d V\] that is directionally path consistent 
w.r.t. -<, 

(ii) V is equivalent to V '. 

As in the case of the DARC Algorithm Theorem 10.4 we do not need to assume 
here that each domain is finite. 

Let us order now each sequence L m in such a way that the function f£™ x ., pre- 
cedes f£™ x „ if the pair lexicographically precedes the pair(j",i"). Denote 
the unique constraint of on Xi,Xj by dj. The above DPATH algorithm can then 
be rewritten as the following triple for loop. The resulting algorithm is known as 
the DPC algorithm of Dechter and Pearl [1988]. 



for to :— n to 3 by —1 do 
for j := 2 to to — 1 do 
for i := 1 to j — 1 do 

Ci.j . — Ci.j n Ci_ m 

od 

od 

od 



12. CONCLUSIONS AND RECENT WORK 

In this article we introduced a general framework for constraint propagation. It 
allowed us to present and explain various constraint propagation algorithms in a 
uniform way. By starting the presentation with generic iteration algorithms on 
arbitrary partial orders we clarified the role played in the constraint propagation 
algorithms by the notions of commutativity and semi-commutativity. This in turn 
allowed us to provide rigorous and uniform correctness proofs of the AC-3, PC-2, 
DAC and DPC algorithms. 

The following table summarizes the results of this paper. 
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Algorithm 
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Commutativity 6.2 


path 
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Path Consistency 7.4, 
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directional arc 


DAC 


SI 


Hyper-arc Consistency 5.2, 


consistency 




(Section 9) 


Semi-commutativity 10.3 


directional path 
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SI 


Hyper-arc Consistency 5.2, 


consistency 




(Section 9) 


Semi-commutativity 11.4 



Since the time this paper was submitted for publication the line of research here 
presented was extended in a number of ways. First, Gennari [2000a] extended 
slightly the framework of this paper and used it to explain the AC-4 algorithm of 
Mohr and Henderson [1986], the AC-5 algorithm of Van Hcntcnryck, Dcville and 
Teng [1992], and the GAC-4 algorithm of Mohr and Masini [1988]. The complication 
was that these algorithms operate on some extension of the original CSP. 

Then, Bistarelli, Gennari and Rossi [2000] studied constraint propagation algo- 
rithms for soft constraints. To this end they combined the framework of Apt [1999a] 
and of this paper with the one of Bistarelli, Montanari and Rossi [1997]. The latter 
provides a unified model for several classes of "nonstandard" constraint satisfaction 
problems employing the concept of a semiring. 

Recently Gennari [2000b] showed how another modification of the framework 
here presented can be used to explain the PC-4 path consistency algorithm of Han 
and Lee [1988] and the KS algorithm of [1989] that can achieve either fc-consistency 
or strong /c-consistency. 

We noted already in Apt [1999a] that using a single framework for presenting 
constraint propagation algorithms makes it easier to automatically derive, verify 
and compare these algorithms. In the meantime the work of Monfroy and Rety 
[1999] showed that this approach also allows us to parallelize constraint propaga- 
tion algorithms in a simple and uniform way. This resulted in a general framework 
for distributed constraint propagation algorithms. As a follow up on this work Mon- 
froy [2000] showed that it is possible to realize a control-driven coordination-based 
version of the generic iteration algorithm. This shows that constraint propagation 
can be viewed as the coordination of cooperative agents. 

Additionally, as already noted to large extent in Bcnhamou [1996], such a general 
framework facilitates the combination of these algorithms, a property often referred 
to as "solver cooperation" . For a coordination-based view of solver cooperation 
inspired by such a general approach to constraint propagation see Monfroy and 
Arbab [2000]. 

Let us mention also that Fernandez and Hill [1999] combined the approach of Apt 
[1999a] with that of Codognet and Diaz [1996] to construct a general framework 
for solving interval constraints defined over arbitrary lattices. Finally, the generic 
iteration algorithm GI and its specializations can be used as a template for deriving 
specific constraint propagation algorithms in which particular scheduling strategies 
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are employed. This was done for instance in Monfroy [1999] for the case of non- 
linear constraints on reals where the functions to be scheduled were divided into two 
categories: "weaker" and "stronger" with the preference for scheduling the weaker 
functions first. 

Currently we investigate whether existing constraint propagation algorithms could 
be improved by using the notions of commutativity and semi-commutativity. 

APPENDIX 

Proof of Commutativity Lemma 6.2. 

(i) It suffices to notice that for each &;-tuple X\, . . .,X k of subsets of the domains 
of the respective variables we have 

■Kj(-Ki{Xi, . . .,X k )) = (Xi, . . .,Xi_i,X-,X i+1 , . . .,Xj_i,X'-,Xj +1 , . . .,X k ) 

= Ki{-Kj{X-L, . . .,X k )), 

where 

x^.= n l (cn(x 1 x ■■■xx k )), 

X'j :=n,'(Cn(Xi x ■■■xX k )), 
and where we assumed that i < j. 

(ii) Let the considered CSP be of the form (C ; x\ G D±, . . .,x n G D „). Assume 
that some common variable of yi , . . ., y k and zi,...,ze is identical to the variable 
Xh- Further, let Sol(C, E) denote the set of d G Di x . . . x D n such that d[s] G C 
and d[t] G E, where s is the scheme of C and t is the scheme of E. 

Finally, let / denote the Wi function of C and g the ttj function of E. It is easy 
to check that for each n-tuple X\, . . ., X n of subsets of D\, . . ., D n , respectively, we 
have 

nt^t^ 1 ' ' ' ■>-*«)) = • • -i X h-\,X' h ,X h+l , . . .,X n ) 

= 7T+(7r+(X 1 ,...,X„)), 

where 

X' h := Il h {Sol{C : B)fl(XiX-x X n )). 

□ 

Proof of Commutativity Lemma 8.1. Note first that the "relative" posi- 
tions of z and of u w.r.t. x and y are not specified. There are in total three 
possibilities concerning z and three possibilities concerning u. For instance, z can 
be "before" x , "between" x and y or "after" y. So we have to consider in total 
nine cases. 

In what follows we limit ourselves to an analysis of three representative cases. 
The proof for the remaining six cases is completely analogous. Recall that we write 
x -< y to indicate that x, y is a subsequence of the variables of V. 

Case 1. y < z and y <u. 

It helps to visualize these variables as in Figure 4. Informally, the functions 
and f£ correspond, respectively, to the upper and lower triangle in this figure. The 
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Fig. 4. Four variables connected by directed arcs 



fact that these triangles share an edge corresponds to the fact that the functions 
f xy and f xy share precisely one argument, the one from P(C x ^ y ). 

Ignoring the arguments that do not correspond to the schemes of the functions 
/* and we can assume that the functions {f XiV ) + an d (/",y) + are both defined 
on 

r(c x , y ) x V(C X , Z ) x V(C VlX ) x P(C X , U ) x V{C v , n ). 

Each of these functions changes only the first argument. In fact, for all elements 
P,Q,R,U,V of, respectively, V{C x , v ),P(C x , z ),V{Cy, x ),P(C x>vl ) and P{C y , u ), we 
have 

(fly) + (fl v ) + (P, Q,R,u,v) = (Pnu-v T nQ- r t , q, r, u, v) 

= (P nQ ■ R T n U ■ V T , Q, R, U, V) 

= (fZy) + (fZ,y) + (P,Q,R,U,V). 

Case 2. x -< z ~< y ~< u. 

The intuitive explanation is analogous as in Case 1. We confine ourselves to 
noting that (f XtV ) + and (fx, y ) + are now defined on 

P(C X , Z ) x P(C X . V ) x P(C\ y ) x P(C XtU ) x P(C VtU ) 

but each of them changes only the second argument. In fact, we have 

(fl v ) + (fly) + (P, Q,R,U,V) = (P,QnU-V T nP- R, R, U, V) 

= (p, Q n p • Rnu -v t ,r,u,v) 

= (fly) + (fly) + (P,Q,R,U,V). 

Case 3. z ~< x and y < u. 
In this case the functions {f x _ y ) + and are defined on 

V{C Z , X ) X P(C Z ,y) X P(C X ,y) X P(C X , U ) X P(Cy, U ) 
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but each of them changes only the third argument. In fact, we have 

ifl y ) + (fl y ) + (P, Q, R, u, v) = (P, q, r n u ■ v T n p t ■ Q, u, v) 

= {P,Q,RC\P T -Qnu -V T , U, V) 

= (fly) + (fly) + (P,Q,R,U,V). 

□ 

Proof of Semi-commutativity Lemma 10.3. Suppose that the constraint Ci 
on the variables u, z and the constriant C2 on the variables x, y, where y < z. De- 
note by /„ ; 2 the tt\ function of C\ and by f XiV the m function of Ci. The following 
cases arise. 

Case 1. {u, z} n {a;, y} = 0. 
Then the functions / MjZ and f XtV commute since their schemes are disjoint. 

Case 2. {u,z} n {x,y} ^ 0. 
Subcase 1. u = x. 

Then the functions f u , z and f XiV commute by virtue of the Commutativity Lemma 
6.2(H). 

Subcase 2. u = y. 

Let the considered CSP be of the form (C ; x\ G Di,...,x n E D n ). We 
can rephrase the claim as follows, where we denote now / U;2 by f y , z : For all 
{X u . . ., X n ) e P(Di) x • • • x V(D n ) we have 

fy,z(fx,y(Xl, ■ ■ -,X n )) D fx, y (fy iZ (Xi, . . .,X n )). 

To prove it note first that for some k e [l..n] such that i < j < k we have 
x — Xi, y — Xj and z — Xk- We now have 

fy,z(fx,y( X l> ■ ■ -> X n)) = (fy,z) + (Xi, . . ., X-, X i+ i, . . ., X n ) 

= (Xi, . . .,Xi-i,Xl, X i+ i, . . ., Xj_i,Xj,Xj + i, . . .,X n ), 

where 

fx,y(Xi,Xj) = (X^Xj) 

and 

fy,z{Xj,Xk) = (X-,Xk), 

whereas 

fx,y(fy,z(Xl, ■ ■ ;X n )) = (f XtV ) + (Xi, . . .,Xj_i,X'j,Xj + i, . . .,X n ) 

= (Xi, . . ., Xi-i, X", Xi+i, . . .,Xj-i,Xj,Xj+i, . . ., Xk), 

where 

fx,y(Xi,Xj) = (X",Xj). 

By the Hyper-arc Consistency Lemma 5.2(H) each function 7^ is inflationary and 
monotonic w.r.t. the componentwise ordering D. By the first property applied to 
fy jZ we have Xj D X'^, so by the second property applied to f XiV we have X- D X". 

ACM Transactions on Programming Languages and Systems, Vol. TBD, No. TDB, Month Year. 



The Role of Commutativity in Constraint Propagation Algorithms • 33 



This establishes the claim. 
Subcase 3. z = x. 

This subcase cannot arise since then the variable z precedes the variable y whereas 
by assumption the converse is the case. 

Subcase 4- z = y. 

We can assume by Subcase 1 that u =f= x. Then the functions f u ,z and f x ,y 
commute since each of them can change only its first component and this component 
does not appear in the scheme of the other function. 

This concludes the proof. □ 

Proof of Semi-commutativity Lemma 11.4. Recall that we assumed that 
x\ ~< y\ -< z, X2 -< y 2 -< u and u -< z. We are supposed to prove that the function 
fxi.yi semi-commutes with the function /" 2 . y2 w.r.t. the componentwise ordering 
D. The following cases arise. 

Case 1. (x\,y\) = {x 2 ,y 2 ). 

In this and other cases by an equality between two pairs of variables we mean 
that both the first component variables, here x\ and x 2 , and the second component 
variables, here y\ and y 2 , are identical. 

In this case the functions f£ l Vl and f X2tV2 commute by virtue of the Commuta- 
tivity Lemma 8.1. 

Case 2. (xi,yi) — (x 2 ,u). 

Then u and z differ, since yi -< z. Ignoring the arguments that do not correspond 
to the schemes of the functions f XltVl and f X2 , y2 we can assume that the functions 
(/zi,yi) + and (fx 2 ,y 2 ) + arc bc, t n defined on 

V(C XUV1 ) x P(C XUZ ) x P(C VUZ ) x V{C X2iV2 ) x V(C y2>u ). 

The following now holds for all elements P, Q, R, U, V of, respectively, V(C Xl , yi ), 
V(C XuZ ),V(C yuZ ),V(C X2>V2 )<mdV(Cy 2 , u ): 

(f^ yi ) + (f^y 2 ) + (P,Q,R,u,v) - (f* uyi )+(P,Q,R,unP-v T ,v) 

= (p n q ■ r t , r, u n p ■ v T , v) 
d (P n g • r t , r,u n (p n Q • r t ) ■ v T , v) 

= (f^, y2 ) + (PnQ-R T ,Q,R,U,V) 

= {f^y 2 ) + {f Z Xuyi ) + {P,Q,R,U,V). 

Case 3. (xi,y{) = {y 2 ,u). 

In this case u and z differ as well, since yi ~< z. Again ignoring the arguments 
that do not correspond to the schemes of the functions f XltVl and f X2tV2 we can 
assume that the functions (f Xl , yi ) + an d {fx 2 ,y 2 ) + are both defined on 

V(C Xim ) x V(C XUZ ) x V(C yuZ ) x V(C X2i y 2 ) x V(C X2iU ). 

The following now holds for all elements P, Q, R, U, V of, respectively, V(C Xl yi ), 
V(C XliZ ), V{C VllZ ), V(C X2 , V2 ) and V(C X ,^ U ): 

(.f^ yi ) + (.f^y 2 ) + (PQ,R,u,v) = (f^ yi )+(pQ,R,unv-p T ,v) 

= (p n Q ■ r t , r, u n v ■ p t , v) 
d (PnQ-R T ,R,unv ■ (p n Q • i? T ) T , V) 
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= (K 2 ,y 2 ) + (PnQ-R T ,Q,R,U,V) 

= (f2 2 , y2 ) + (ti uyi ) + (P,Q,R,u,v). 

Case 4. (x 1 ,y 1 ) £ {(x 2 ,y 2 ), (x 2 ,u), (j/2,«)}- 

Then also (x 2 ,y 2 ) ^ {(zi, j/i), {x\, z), (t/i, 0)}, since (x 2 ,y 2 ) ^ (£1,3/1) and y 2 ^ z 
as t)2 < u < z. 

Thus the functions f£ l Vl and /" 2i!/2 commute since each of them can change only 
its first component and this component does not appear in the scheme of the other 
function. 

This concludes the proof. □ 
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